Bayes’ estimators of generalized entropies
نویسنده
چکیده
The order-q Tsallis (Hq ) and Rényi entropy (Kq ) receive broad applications in the statistical analysis of complex phenomena. A generic problem arises, however, when these entropies need to be estimated from observed data. The finite size of data sets can lead to serious systematic and statistical errors in numerical estimates. In this paper, we focus upon the problem of estimating generalized entropies from finite samples and derive the Bayes estimator of the order-q Tsallis entropy, including the order-1 (i.e. the Shannon) entropy, under the assumption of a uniform prior probability density. The Bayes estimator yields, in general, the smallest meanquadratic deviation from the true parameter as compared with any other estimator. Exploiting the functional relationship between Hq and Kq , we use the Bayes estimator of Hq to estimate the Rényi entropy Kq . We compare these novel estimators with the frequency-count estimators for Hq and Kq . We find by numerical simulations that the Bayes estimator reduces statistical errors of order-q entropy estimates for Bernoulli as well as for higher-order Markov processes derived from the complete genome of the prokaryote Haemophilus influenzae.
منابع مشابه
Non-linear Bayesian prediction of generalized order statistics for liftime models
In this paper, we obtain Bayesian prediction intervals as well as Bayes predictive estimators under square error loss for generalized order statistics when the distribution of the underlying population belongs to a family which includes several important distributions.
متن کاملTruncated Linear Minimax Estimator of a Power of the Scale Parameter in a Lower- Bounded Parameter Space
Minimax estimation problems with restricted parameter space reached increasing interest within the last two decades Some authors derived minimax and admissible estimators of bounded parameters under squared error loss and scale invariant squared error loss In some truncated estimation problems the most natural estimator to be considered is the truncated version of a classic...
متن کاملGeneralized information criteria for optimal Bayes decisions
This paper deals with Bayesian models given by statistical experiments and standard loss functions. Bayes probability of error and Bayes risk are estimated by means of classical and generalized information criteria applicable to the experiment. The accuracy of the estimation is studied. Among the information criteria studied in the paper is the class of posterior power entropies which includes ...
متن کاملLimiting Properties of Empirical Bayes Estimators in a Two-Factor Experiment under Inverse Gaussian Model
The empirical Bayes estimators of treatment effects in a factorial experiment were derived and their asymptotic properties were explored. It was shown that they were asymptotically optimal and the estimator of the scale parameter had a limiting gamma distribution while the estimators of the factor effects had a limiting multivariate normal distribution. A Bootstrap analysis was performed to ill...
متن کاملBayes Estimators of the Scale Parameter of a Generalized Gamma Type Model
Abstract Bayes estimators of the scale parameter of a generalized gamma type model are obtained for different priors. For the proposed prior, Bayes estimator of θ for given p and k=1 coincides with MLE of θ if c=2, whereas Bayes estimator of hazard rate function of θ given p and k coincides with its MLE. Thumb’s rule has been used for constructing a conjugate prior for θ . Bayes estimators of r...
متن کامل